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Abstract 

A theory for the complexity of the Bethe lattice spin-glass is developed applying to the cavity-method 
scheme of Mezard and Parisi the results recently obtained in the context of the Sherrington-Kirkpatrick 
model. The crucial ingredient is the introduction of a new cavity field z related to the marginality of 
the relevant states. The theory admits a variational formulation. In the high-connectivity limit it yields 
the Bray and Moore expression for the TAP complexity of the SK model. An annealed version of the 
theory is also studied in order to obtain non-trivial results at low computational cost. An analysis of 
the theory is performed numerically through population-dynamics algorithms and analytically through 
power series expansion. The results can be applied to other finite connectivity problems. 

1 Introduction 

The work of Mezard and Parisi on the Bethe lattice spin-glass j3J 0] has shown that the cavity method is 
an essential tool in the context of disordered system. Conceived originally in order to recover the results of 
the "replica method without replicas" its application to finite connectivity problems and in particular 
the possibility of applying population-dynamics algorithms to obtain non-perturbative results has given a 
considerable boost to the field of disordered systems and optimization problems in the last three years, 
see e.g. [SJE]. In this work we will apply the results recently obtained in the context of the SK model 
[171 1181 123 to the Bethe lattice spin glass, developing a general theory for the logarithm of the number 
of states of this model, i.e. the Complexity. The theory can be applied also to other finite connectivity 
and optimization problems. We will basically follow the path opened in [3] whose detailed knowledge is 
therefore essential to read this work. For this reason we will not present a self-contained discussion of the 
Bethe lattice spin-glass and the notation as well will be borrowed from 

1.1 Basic Ideas of the Theory 

The basic idea of the theory is that the relevant states at a given temperature, i.e. those yielding the total 
complexity must be marginal states . Indeed if we expect the complexity to decrease upon an infinitesimal 
increase of the temperature these states must suddenly disappear |27| . This is indeed what happens in the 
SK model according to the BM theory due to the presence of a vanishing isolated eigenvalue ^| ED |27| in 
the TAP spectrum. This makes the application of the Cavity method to these states impossible because 
one of the basic hypotheses of the method is that the states can be continued analytically upon adding a 
new spin to the system. In |27| it was shown how to avoid this problem in the context of the SK model 
and the whole BM theory was recovered within the cavity method. The idea is to consider states different 
from the relevant ones. This can be done for instance considering the number of states with a self-overlap 
q different from q* , the self-overlap of the relevant states. These non-relevant states exist in an exponential 
number although smaller than the relevant ones. These states are no more marginal and the Cavity method 
can be applied to them in order to compute their complexity; at the end the result for the total complexity 
is obtained by taking the limit q q*. In this limit the marginality of the states reflects itself in the 
divergence of some parameters of the theory. In this work we use these ideas to develop a theory for the 
complexity of the spin-glass on the Bethe lattice. 
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In |27] the selfoverlap q of the TAP solutions was used in order to select a set of solutions different from 
the relevant ones, here we stress that any parameter X but the free energy can be used. Indeed the total 
complexity cannot depend on the parameter used and in the limit X — > X* the computations with different 
parameters are equivalent. In the present context we will use the magnetization and not the selfoverlap in 
order to take full advantage of the tree structure of the lattice. Indeed the relevant objects to be computed 
are the shifts of the quantities of interest in various branch-merging processes and in the next section we 
will see that the shift of the magnetization, being simply the derivative of the free energy shift, can be 
expressed in terms of a few branch parameters, i.e. the cavity fields hi and their derivatives h^. The 
same computation with the self-overlap would be much more complicated. Therefore we will compute the 
function £(it, Am) which in the thermodynamic limit is the Legendre transform of the complexity £(/, M) 

E(/,M) = In53<y(M-M Q )d(/-/ a ) ; t(u,X M ) =lnJ2^ a0U ~ XMMa W 

a. a 

In particular we are interested in the Am — * limit of E(0, Am) that yields the total complexity. 



2 The Cavity Method on the Bethe Lattice 
2.1 Extensive Quantities 

In this subsection we report two important relationships that allow us to express an extensive quantity 
in terms of averages of proper shifts. Such relationships can be proved using the topological argument 
represented pictorially in fig. (2) of @|. If the quantity A is extensive, that is 



then the following relationships holds 



lim A= Na, (2) 

N— too 



-(AA^) -k(AA^) (3) 



a = ^±l(AA( rfe '')) - ^-1(AA«) (4) 

where AA^ is the shift of A upon adding two spins to a system of 2k branches, AA^ is the shift of A 
upon adding a spin to a system of k + 1 branches and AA^ tter ' is the shift upon adding a spin to a system 
of k branches. The square brackets mean disorder average. Following 0] we note that the first relationship 
can be obtained removing 2k spin from the system Si that is a Bethe lattice of N spin. The new system 
is called Sq and has N — 2k spins. Then the system Sa is obtained merging the 2k(k + 1) free branches of 
So in groups of 2 k to a couple of spins. Now S 2 is a system of N + 2 spins and 

a = \{A{S 2 ) - A(Si)) = \({A(S 2 ) - A(S )) - (A(Si) - A(S )) (5) 

where the square brackets mean disorder average. Now equation J3J can be easily derived noting that 

(A(S 2 )-A(S )) = (k + l)(AA^) :(A(S 1 )-A(S )) = 2k(AA^} ; (6) 

The second relationship, eq. (J3J can be obtained in a similar way. We start removing k spin from the 
system Si obtaining the system Sq with N — k spins. Then the k(k + 1) free branches are merged in groups 
of k yielding the system Si n t with N + 1 spins and k + 1 free branches. Merging the k + 1 branches of 
Sint we obtain the system Sfi n that is a system with the topology of the Bethe lattice (i.e. with no free 
branches) and N + 1 spins. Then the shift between the system Sfi n and Si can be expressed in terms of 
(AA' 1 ') and (AA^^) yielding eq. 0). 
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2.2 Fields, Shifts and Distribution Functions 



The function E(u, Am) is an extensive quantity, therefore according to the previous section it can be 
expressed as the average over the disorder of proper shifts. The shift in E in the process of merging if fe + 1 
branches is given by: 



AE(u,A m ) (1) = In 



,u(3F a + A m M a +u0 Af£ } + Am AM™ 



J2 e u0F a + X m M a 

The free energy and magnetization shifts can be computed starting from the following equation 0: 



where 



2J exp(/3cr ^c r + PH ext <7 + (3ha) = c(J, /i) exp(/3u(J, ft,)cr + PH ext a a ) 

<r=±l 

/ t ,n 1 ,r ,/^ t n , ,,,>, , t ,n cosh(/3J) cosh(/3ft) 

u ( J, ft) = -arctanh tanh (/3 J tanh(/3ft) ; c(J, ft) = 2 \ , / , — 

p cosh{pu{ J, ft)) 



The free energy shift in the process of merging + 1 lines is given by |3] : 



/3AF (1) = In 



fk+i 



2 cosh ^(3u(J u hi) + /3ff e 



fc+i r 

E 



cosh /3 J, 



cosh 0u(Ji, hi) 



(7) 
(8) 
(9) 

(10) 



The magnetization shift can be computed deriving the previous expression with respect to the external 
field H ext : 



AAf' 1 



dH ext 

k+l 



AF (1) - tanh f ^ Pu{Ji,hi) + PH ex ^j 



k+l 



+ ^ ( tanh [ ^ Pu{Jj,hj) + (3H ext ] - tanh/3u( J i; ft,) 



i=l 



dft,- 



Notice that the magnetization shift depends on the fields hi but also on their derivatives 

h' 



dH e 



(11) 



(12) 



this is the most important modification of the standard approach. We also write the expressions of the new 
field fto and h' acting on the central spin in the merging process; the equation for fto is the same of |3j and 
by derivation we obtain the one of h 



k+l 



= ^ u(Jj, tlj) + H^t 



i=l 
k+l 



K = E 



du(Jj, hj) , 
dhi 1 



(13) 
(14) 



The hypotheses of the Cavity Method [3 El can be easily extended to the present discussion. We assume 
that the free energies F a and magnetization M a of the states are independent random variables with respect 
to the disorder. It is also assumed that the free energy and magnetization of a state are independent of 
the field h a and of its derivative h' a . The distribution is such that on each sample the average number of 
states with free energy F and magnetization M is exponential. Therefore on a given sample we can write: 



dAf(F,M,h,h') oc exp[w/3F + X M M]Pi(h, h') 



(15) 



Where Pi (ft, h') represents the fraction of states [§] with fields ft and ft' and the suffix i is used to remember 
that this function depends on the branch considered. These hypotheses are self-consistent under the process 
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of merging of fc + 1 branches; indeed we have: 



„ fc+i 
dM{F^ k+1 \M^ k+1 \h ,h' ) cx / ey^lu^F + X M M}dFdMj^P i {h h h l i )dh i dh l i 



i=l 

fc+1 \ / fc+1 



dhi 

i—l / \ i—l / 

x S(F + AF^ - F( fc+1 ))5(M + AM* 1 ' - M ) cx 

cx exp[PuF^ +\ M M}P^ +1) (h ,h' ) (16) 

From the last equation the expression for P Q +1 \ho, h ) can be obtained in terms of the distributions 
P^hi.h'j). The suffix (fc + 1) is used to distinguish the distribution of the fields ho and h' coming from 
the process of merging fc + 1 branches from those of the fields hi and h\ that instead are obtained merging 
fc branches. It is important to notice that while the final free energy and magnetization are correlated to 
the fields hi and h\ they are not correlated with the field ho and h' Q . Furthermore, since the free energy 
and magnetization before the merging process are not correlated to the fields hi and h'^ they are not even 
correlated to the free energy and magnetization shifts; therefore in the summation in eq. J7J) the part 
depending on the fields factorizes and we obtain: 

„ fc+i 

AE(«, A m ) (1) = In / Y[ Pi(h, h'^dhdK exp[w/3AF (1) + X M AM^] (17) 
J i=i 

In order to obtain the disorder average of the previous shift we need to know the distribution over the 
disorder of the functions P(hi,h'i). Since these functions refer to the system before adding the central 
spin they are not correlated and we can consider the distribution of Pi(hi, h'i) on a generical branch. This 
distribution of distributions satisfies a recursive equation. Let us start deriving the expression for Po(^o, h' a ) 
in the process of merging fc branches. By definition it is the distribution of the field h$ and h'^ when the 
states are weighed with a weight proportional to exp[{3uF a + At\/M q ]: 

wo, K) = ^ e Eae0UF J:z ha) (is) 

A recursive expression of Po(ho,h ) can be obtained either by expressing the previous equation in terms 
of the fields hi and h'i through the analogue of eqs. (|13fl and l|14(l and recalling that the shifts are not 
correlated to the free energy and magnetization before the merging or equivalently from the analogue of 
relation H16|) applied to the merging of fc branches. The result is: 

P (h Q ,h' n ) = ; - /" TT Pdhuh'Adhidh'i x 

x e ^« +AMAM( ««^ ^ _ £ u( ^ ^ _ Ha >j g - lVl9) 

where AM' 1 ' 6 ''' is obtained much as AM' 1 ', eq. Ijlll) . merging fc branches instead of fc + 1. Then the 
distribution of distributions V[P(h, h')] satisfies the following equation: 

V[P(h,h')} = J ^VlPihiX^dPiihiXminKh^-PihoX^J (20) 

i—l 

Where P(ho, h' ) depends on Pi(hi, h^) through eq. (|19f) and the square brackets mean average over the fc 
bonds Ji. 
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3 The A M Limit 

In order to study the total complexity or more generally the curve £(/) we must study the Am — ► limit 
of the theory. We will show that this is different from simply putting Am = everywhere in the theory if 
the fields h\ diverge in this limit. In order to account for this divergence we introduce the rescaled fields Zf 

Zi = \ M K (21) 

According to eq. I|14|) zq satisfies the following recursion equation 

z =£^%^+Am (22) 

i—l 1 

The theory can be simply reformulated in terms of the fields Zi at Am finite because the magnetization 
shift is always multiplied by Am in the expression of the complexity shift or in the recursion equation for 
PqQiq, h' ); therefore the relevant object is: 



A M AAfW = = A M tanh ^ /3u(J h h) + /3H ex ^j 



k+l I I k+l 



+ I tanh I ^Pu{J J ,h J )+ l3H ext I -t&nhf3u{J l ,h l ) I ^-z t (23) 



In the limit Am — > the previous expression remains finite if the fields Zi remain finite. Notice that instead 
the first term will go to zero anyway. The introduction of the fields Zi is very important because it allows 
us to formulate the theory directly at Am = in terms of the fields hi and Zj. In the following we set 
H ex t — for simplicity. The recursive equations for the fields are: 



k+l 



h = ^2u(J h hi) (24) 



i=i 
fc+i 



zo = £^4* (25) 



The anomalous shift is given by the Am — > limit of eq. J22J: 

k+l / I k+l \ \ , 

AX (1) = J2 ( tanh ( Y^Pv>{Jj,hj) \ - tanh /3u(Ji, hi) j -^-z, (26) 

The recursive equation for the distribution of the fields ho and zo is derived from eq. (|19(l : 



x e 



^ W+AI " Siho-Y: <Ju h)]s[z -J2 d ^±z l (27) 



dh 

\ i=i / \ i=i / 

The distribution of distributions V[P(h, z)] satisfies the following equation: 

V{P(h,z)] = Jl[V{P(h i ,z i )]dPi(h i ,z i ){S((P(h,z)-P(ho,z )))j (28) 

i=l 

where P(h ,z ) depends on Pj(/ij, Zi) through eq. (|27|l and the square brackets mean average over the k 
bonds Jj. The Complexity shift is 

„ fc+i 

AE(u) (1) = In / Y[Pi(hi,Zi)dhidzi exp[u/3AF (1) + AAT (1) ] (29) 
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According to equation J3J the Legendre transform with respect to u of the complexity is given by 

S(«) = ^ / n^( J R t (^,^))(AS( M )^)) J -^ /'nP(P l (^,z 4 ))(AS( U ) (1) >.7 (30) 

i—1 i—1 

where the square brackets mean average over the bonds J h and A£( iter ) has the same expression AX^ 1 ' 
with k indexes instead of k + 1 . At u = eq. ||5U)| gives the total complexity. 



4 Variational Expression of the Complexity 



In this section we derive the expression for the complexity that one can obtain considering the process of 
merging of 2k branches to a couples of spins according to eq. © . We will check that if the distribution 
of distributions V(P(h, z)) satisfies equation (|28|> then the two expressions are equivalent. Furthermore it 
can be checked that the expression we recover is variational [3J EH m the sense that equation l|28[l can be 
obtained extremizing it with respect to V{P(h, z)). 

The free energy shift in the process of merging 2k branches with fields {hi, . . . , h k } and {gi, . . . , gk} to 
a couple of spin ctq and Tq is [3]: 



(3AF 



(2) 



cosh Ji cosh f3Ki 



cosh/3u( Ji, hi) cosYij3u(Ki,gi) 



+ 



In 



E exp /3J a T Q + /3a ^ u(Ji, hi) + /3t u(K it g t ) 



i=i 



i=l 



Introducing the notation 



dfji 



dH ex t 

the corresponding anomalous shift can be obtained much as in the previous section: 



(31) 



(32) 



AX< 2 > = ]T 

k 

+ E 



tanh I ^^/3u(Jj,hj) + (3u I Jo,'^^f3u(Kj,gj) — t&nh(3u(Ji, hi) 

v =i v ^ J J 

tanh I j3u(Kj,gj) + [3u I Jo,~^^/3u(Jj,hj) — t&vh. f3u(Ki, gi) 



du. 
dh 



■Zi + 



\i =1 



(33) 

dg l 



We call Qi(gi, yi) the distribution of the fields gi and Zi to distinguish it from Pi{hi, z,-); then the Complexity 
shift reads 

At(u)W = In [jlPiih^zJdhidzi Q l (g l ,y t )dg l dy l exp[upAF^ + AX< 2 '] (34) 

^ 2=1 

According to equation the Legendre transform with respect to u of the complexity is given by 

S(«) = ^yi / HviPiihuZiVPiQiiguyiMAtiu)^^ - k J Y[v(P t {hi, z t )){At(u) {1) ) j (35) 

i=l i—1 

where the square brackets mean average over the bonds Ji and Ki. Notice that at u = this expression 
gives the total complexity. In order to prove the equivalence of eq. I|30(l and eq. I|35(l we need the following 
relationship that follows from the expressions of AF^ 2 \ eq. (|31|l and of AF^\ eq. (|10|) 

AF (2) (ft,i, . . . , h k , gi, . . . , g k , Ji, . . . , J k , Ki, . . . , K k , J ) = 
= AF« (hi,...,h k ,h ,Ji,...,J k ,J ) + F^ (gi,...,g k ,Ki,...,K k ) (36) 



G 



Where ho is the field generated by the k fields {gi}- By derivation we obtain an analogous relationship 
between AX' 2 ', eq. and AX^\ eq. 

AX^ihi, z\, . . . , h k , z k , 31, yi ■ ■ ■ , gk, Vk, Ji, ■ ■ ■ , Jk, Ki, . . . , K k , J ) = 
= AXW(h u fo, z fc) ho, z , Ji, . . . , J fe , Jo) + AX^ er \ gi , yi , . . . , 3 fe , y k , K u ..., K k ) (37) 

Where zq is the field associated to ho and generated by the k fields {3i,J/i}. The distribution Po(ho,zo) 
can be obtained from the distributions Qi(gi,yi) through equation l|27l) . using this equation and eqs. (|3fcil> 
and l|37|l we obtain: 

AS(m) (2) (P 1 (/i 1 , Zi), . . . , P k (h k , z k ), Qi(gi, yi) Q k (g k , yk), Ji, ■ ■ ■ , Jk, K x , . . . , K k , J ) = 
= AS(u) (1) (Pi(/ii, zi), P k (h k , z k ),Po(ho, z ), Ji, . . . , J k , Jo) + 

+ At(u)^ er \Q 1 {g 1 ,y 1 ),...,Q k (g k ,y k ) 1 K 1 ,... 1 K k ) (38) 

Replacing this equation in eq. 1)35(1 . introducing a (5-function on P{h, z) like the one in eq. ((28(1 and inte- 
grating over P(h,z), we readily obtain the equivalence between expression 1(35(1 and 1(30(1 . In the following 
we prove that ((35(1 is a variational expression. We extremize it with respect to a generic distribution of 
distributions V[P[h, z)\ with the condition that it is normalized. This can be done introducing a La- 
grange multiplier that multiplies the integral of V\P(h, z)] over the space of the distributions P(h, z); as a 
consequences the variational equations are: 

*s(mM)]) _ const f39) 

8V[P{h,z)] ~ C ° nSt - [6J > 
Deriving ((35(1 with respect to V[P(h, z)] we obtain: 

St(V[P(h,z)}) 



5V[P(h,z)} 



Y[V[Pi(hi,Zi)] x 

i=2 



x k(k + l) |^y'nP[Q l (3 l ,^)](AS(u)( 2 )) J ^-y'p[Po^o^o)](Al]( M )( 1 ))^ (40) 



Replacing eq. ((38(1 in the integrand and performing the same manipulations described above we can show 
that the integrand in the second line of ((40(1 does not depend on V[Pi(hi, Zj)], therefore it is a constant: 



5t{V[P{h,z)]) 
SV[P(h,z)] 

5 The SK Limit 



const. = fc(fc+l)/'jJP[Qi(ff i ,|«)](AE(u)( iter ') jr (41) 



In this section we will study the high connectivity limit of the theory recovering the BM calculation of the 
TAP complexity of the SK model JT]. The critical temperature satisfies the relationship: 

(tanh 2 ^ c J>. 7 = y (42) 
k 

in order to have f3 c = 1 at any k, and in particular in the high connectivity limit, the strength of the bonds 
must depend on k: 

J = iarctanh-^ = ±—= + O ( - ) , C = 1 (43) 
Vk Vk \kj 

In this limit the functions u and du/dh entering the recursion equations eq. 1(24(1 and 1(25(1 become: 

u(J,h) = Jtanh/3/i (44) 

^ = J 0(1 -tanh 2 /3/i) (45) 
ah 
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As a consequence the recursion equations <|24[1 and (|25[1 become: 

k 

h = y^Jitanhphi (46) 



i=l 
k 



Ji0O—tanh 2 0hi)Zi (47) 



The anomalous shift of the iterating process is the analogue of eq. (|2l)|) : 

k , 

AI (,ter) = tanh(Ph )z - ^ tanh0u(J h h i )-£-z l (48) 

i—l 2 

where we have replaced the recursive equations for ho and zo in the first term. In the high connectivity 
limit the second term becomes a constant and we have: 

AI (,fcr) = tanh(/%o)zo + const. (49) 

The distribution function of the variables ho and z$ before the reweighing is a Gaussian, see £Q, Pg. 71. In 
principle the means of this Gaussian distribution depend on the disorder; for simplicity however we assume 
that this is not the case. This hypothesis yields the annealed complexity, (see discussion in |2Z]) and is 
correct for the total complexity according to the BM theory |ll| . According to eqs. I|46|) and (|47|l the 
covariances of the Gaussian distribution are 



(h 2 ) G auss = ^J2unh 2 ph^(m 2 )=q (50) 

i=l 

1 fc A 
(h z )Gauss = - (3 tank j3hj(l - tanh 2 (jhj)zj = /3(m(l - m 2 )z) = — (51) 

k i=i P 

k 

(z-Dcauss - -^/3 2 (l-tanh 2 /3^) 2 ^ 2 = /3 2 ((l-m 2 ) 2 z 2 ) =2A (52) 

i=l 

The averages labelled by the suffix Gauss, refer to the distribution before the reweighing. The averages 
without suffix refer to the reweighed distribution we will derive below. The last relation on each line is 
respectively the definition of the parameter q, A and A. According to eq. (|49|l the reweighted distribution 
is: 

1 / , \ sy-i ( h 



P{h,z) = Kcxp[--( h z)C _1 ( z )+ztanh/3h] (53) 



where 

C =(| 2 t) < 54 > 
and K is the normalization constant. Performing the change of variable 

m = tanh j3h , (55) 
and integrating over z, we obtain the BM form [TT] : 



(tanh to — Ato) 2 , 9 

— W 2 — +Xm 



dm (56) 



Where K' is a normalization constant. The expression of the reweighed distribution can be used to compute 
self-consistently the parameters q, A and A. According to eqs. (|50I51I52I) . we have: 

q = (to 2 ) (57) 

^ = (3(m(l-m 2 )z) (58) 

2A = /3 2 ((1-to 2 ) 2 z 2 ) (59) 
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Where the square brackets mean average with respect to the reweighed distribution eq. (|53|) . Integrating 
over z we immediately recover from eq. <|57[) the analogous equation of the BM theory [111 . In order to 
simplify the other equations we notice that: 

/3(1 - m 2 )z = J-2 tanh f3h (60) 

Introducing the shorthand notation G(h, z) for the Gaussian part of P(h, z): 

G(ft,z)=exp[-i( h z)C^^ h z ^ (61) 

we have: 

— = K mG(h,z) — expfz tanh (3h]]dhdz — 
p J dh 

= K J ——jj-G(h,z) exp[z tanh (3h]dhdz — K J m ^—G(h, z)^j exp[zta,nh/3h]dhdz — 

= /3(1 -q) -Kjm (jj^G(h,z)j exp[z tanh )3h]dhdz (62) 

The integration over z in the second term can be performed explicitly, see |27|. the final result is equal to 
the BM equation for A: 

A = -y (1 - q) + — (mttmhT 1 m) (63) 
The equation for A can be derived analogously; from eq. I|59|l and eq. (|60|) we have 

2A = K J G(h, z) ^— z tanh/3/i^ exp [z tanh /3h] dhdz = 

f ( d 2 \ f d 2 

= K ( -jj-^Gih, z) J exp[zta,nh(3h]dhdz + K / G(h, z)-jj^ exp[zta,nh [3 h]]dhdz 

The integration over z in the first term can be performed explicitly, following 27 we have: 

K J Q^G(M)) e*p[zta*hflh]dhdz = ~ (l - 

To compute the second term we note that: 

d 2 

—r^z tanh j3h = 2(3 2 zm(l - m 2 ) (66) 
dh z 

Therefore, according to the equation for A, eq. (|58() we have: 

f d 2 

K / G(h, z)— exp [z tanh f3h] = 2 A (67) 
J dh z 

Putting all together we obtain 

x = A _L( 1 _((^- 1 m-Amr)\ 
2q V q(3 2 ) 

This is precisely the equation corresponding to the extremization of the BM action with respect to the 
parameter q. 



(64) 



(65) 
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6 The Annealed Theory 



In this section we develop the annealed formulation of the theory. The advantage of this approach is 
that it gives non-trivial information on the complexity at the price of the replica-symmetric solution, i.e. 
considering a single distribution P ann (h, z). 

We discuss the annealed formulation considering the standard cavity method with only the field h and 
the parameter u. The generalization to the present theory is straightforward and we will simply report 
the full equations at the end of this section. Instead of computing the Legendre transform of the physical 
complexity, i.e. 

t{u) =ln^ e -^/<* , (69) 

a 

where the bar means average over the disorder, we compute 



E ann (u)=ln53e—««.. (70) 

a 

Notice that although the correct physical object is the first one, the second one is a well-defined analytical 
object that gives an upper bound to the first because of the convexity of the logarithm. It is easy to verify 
that this object is the Legendre transform of the annealed complexity defined as: 



E(/) = ]n£ *(/-/„) (71) 

a 

The derivatives of the annealed complexity produce annealed averages defined as: 



(O) = = ■ (72) 

The quantity E(u) is clearly an extensive quantity; therefore, according to section !^. II it can be expressed 
as the sum of proper shifts, see eqs. (0 and Thus we are interested in the shift in the process of 
merging k + 1 branches that reads: 



uftF -{-u^AF^ 1 ^ 

AS W„ («) = In z uPFa +^ AF ^ - In eU/5Fa = ln ^ a — (73) 

According to the hypotheses of the cavity method, on each sample the free energies are not correlated with 
the fields and with the free energy shift, see the discussion of eq. (|16fl . therefore we may write: 

^ e * + „^) = ^ e ^ fl[P i h i dh i e X p\PuAFW{J 1 ,...,J k ,h 1 ,...,h k )] (74) 

In order to perform the disorder average of this quantity we note that before the merging process the 
branches are not correlated and the states of the system of k + 1 branches are the product of the states of 
each branch with free energy equal to the sum of the free energy on each branch. Thus we may write the 
following relationships: 

a i— 1 CLi 
fc+1 



fc+1. 



H Pi{hi) = HY.eP^PM (77) 



10 



as a consequence the disorder average of eq. I|74f) reads 

. fc+i 



^ e * + ^AF«" = j f[J2^ uF ^Pi{h i )dh i (exp[puAF^(J 1 ,...,J k ,h 1> ...,h k )})j (78) 



i— 1 a 



We introduce the function P ann (h) defined as the annealed average of the field distribution Pj(/ij) of the 
generic branch i 

P ann (h) = ^= _—l 11 , (79) 

then replacing in eq. (|78|l and using eq. I|76|) we obtain: 

„ fe+i 

ASW,(«)=ln / nP own (^)dfe i (ex P [^uAJJ'W(Ji,...,J Jb ,fci > ...,/i fc )])j (80) 

i— 1 

The recursive equation for the annealed distribution P an n{h) can be obtained in a similar way starting 
from the iterative equation on a give sample, eq. 127[) . The annealed theory can be easily generalized to 
the case with non-zero fields z and non-zero anomalous shifts AX . The complexity shifts are: 

AE«„(u) = In / H PanniKzijdhi dz^e^uAF^ + AlW])j (81) 
AE^» = In y [] P ann (hi, Zi)dhi d Zl P ann { 9ll Vl )d 9l d yi (exp[PuAF^ + AX^}), lK (82) 



where the free energies and anomalous shifts where defined in eqs. ()10I26I31I33|) . The Legendre transform 
of the complexity can be obtained from eqs. © or 10} as: 

"""" *' + 1 AE«,(«)-*A£E&.(«) (83) 



TV 2 



TV 

The equation for P ann {h, z) is: 



"""" = ^AS^W-^ASWju) (84) 



i=l 



(e^"^^ 1 "^ (fc-5>(J 4 ,fc) ) <5 U-£^^)>, ( 8 5) 



6.1 Variational Formulation of the Annealed Theory 

The annealed theory admits a variational formulation much as the general theory. Indeed in this section 
we will show that the equation (|85|l is identical with the equation one obtains extremizing expression l|83|) 
with respect to the function P ann (h, z). Notice that while in the general theory the object over which we 
cxtrcmize is the distribution of distributions V[P(h, z)\, in the annealed theory the object over which we 
extremizc is simply P an n(h, z). In order to prove this property we start by proving the equivalence of the 
expressions Ij83(l and (|84|l . To do this we recall the relationships that connect the free energy and anomalous 
shift in various systems, eq. (|36J) and eq. Ij37(l . Putting these equations in eq. Ij82(l and introducing two 
^-function over ho and z$ like those of eq. 185|) as in section 21 we obtain: 

ASH = AE« n + AE^) (86) 
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This equation yields immediately the equivalence between the expressions (|83[) and (|84|l . The functional 
derivative of expression l|83[l with respect to P ann (h, z) is 



ST, 



SPann{h,z) 

Where the integrand / is given by: 

t „-A£l 2 > 



k(k + l) fY[P ann (hi,Zi)dhidziI (87) 

^ i=2 



Y[Pann(g t ,y i )dg t dy i (ex P [PuAF^ + AX^]) J>K 
J 1=1 

A& « L I Pann(ho,z )dh dz Q (exp[puAF^ + AXM])j 



Using once again eq. I|36[) and ea. (|37[l and introducing two S functions on ho and zq like those appearing 
in eq. (|85|l we obtain: 

I = ( e -AsS„+Asi«r' _ g-As^) J p ann (ho,Zo)dhodzo{eMPu&F (1) + A* (1) ]> J = (89) 
the latter equality follows from eq. I|86l) and proves that expression l)83fl is extremized by P an n(h, z). 



7 Solving the Equations 

We have studied the annealed and the general theory at u — by means of population dynamics algorithms. 
The most important result of this analysis is that in both cases the algorithms converge to populations 
with non-zero values of the fields z meaning that the whole theory is non trivial. 

The procedure is the same of Mezard and Parisi 3 : thereby we consider a population of Af populations of 
M. couples of fields {h, z} and we replace one of its elements generating a new population. The replacement 
is done sequentially over the Af populations. To generate the populations we used a simplified version of 
algorithm B of [3], that is at each iteration we generate through a merging procedure a population of M. 
couples of fields {h, z} with the corresponding AX^ ter ^ shifts, then we generate a new population picking 
up A4 couples of fields from the original population with weights proportional to exp[AX^* er ^]. The main 
difference with the standard case is that we have to consider couples of fields instead of the single cavity 
field, therefore in order to obtain the same precision on the function P(h, z) we need to consider larger 
values of M. with larger computation time. 




Figure 1: Left plot, continuous line: the function C ann (h) defined in the text, at k — 5, T — .3; dashed line: 
the function C ann (h) in the SK model at the same temperature. Right plot, continuous line: the function 
C ann (z) defined in the text, at k = 4, T — .3; long-dashed line: the function C ann (z) at k = 5, T — .3; 
dashed line: the function C ann (z) in the SK model at the same temperature 
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The annealed theory requires only one population and thus more precise results can be obtained. In 
figure^we plot the cumulative functions with respect to h and z of the function P an n(h, z) at temperature 
T = .3 and connectivity k — 4, 5: 

/oo ph 
dz / dhP ann (h,z) (90) 
-oo J h m i n 

/z rhmax 
dz I dhP ann {h,z) (91) 
-OO J hmin 

where according to eq. I|24[l we have h max — —h m i n — k arctanh(fc -1 / 2 ). The dashed lines represent the 
corresponding SK result given by eq. (|53|l . 




Figure 2: Left plot: the cumulative function of an average population representing the function C av (h) 
defined in the text, at k = 5, T = .3 obtained from a population of J\f = 300 populations of M. — 1024 
couples of fields {h, z}. Right plot; the cumulative function of an average population representing the 
function C av {z) defined in the text, at k = 5, T = .3 obtained from the same population of M = 300 
populations. 



In figures J5J we plot the cumulative functions C av (h) and C av (z) of the quenched average P av (h, z) of 
the distributions Pi(hi,Zi): 

P av (h, z)= [ P(h, z)P[P(h, z)]dP(h, z) (92) 



The function P av (h, z) in the plot is represented by an average population of A4N couples obtained merging 
in a single population all the AT = 300 populations of Ai = 1024 couples of fields at temperature T = .3 
and connectivity k — 5. The function P av (h, z) must be a smooth function invariant under the exchange of 
{h, z} with {—h,—z}, but this is true only approximately for the cumulative distributions of the average 
population plotted in figure (J2J) due to the finite dimension J\f of the population of populations; indeed the 
single populations are not invariant with respect to the exchange of {h, z} with {—h, —z} and have quite 
large deviations from P av (h, z). 

The complexity is extremely small at finite temperature, therefore its value and in general the shape of 
the function £(/) require a more refined treatment that goes beyond the scope of this work. To confirm 
the smallness of the complexity we have studied the annealed theory by means of computer assisted series 
expansion in power of the reduced temperature r = T c — T '. These expansions yield good results near 
T c = 1 and can be used in the whole low temperature phase provided some resummation scheme is applied 
[21Q31. At k = 2 we found 

£arm(fc = 2) = 2 ^arctanh-^ r 6 + 0(r 7 ) (93) 
we note that in the SK model one finds the same r 6 behaviour |HM13llT5] . 



13 



8 Discussion 



We have obtained a theory for the Complexity of the Bethe lattice spin-glass which is the analogue of 
the non-SUSY solution for the TAP complexity of the SK model. As explained in section ITTl within this 
theory the relevant states are marginal, a feature that is encoded in the finiteness of the rescaled fields z 
or equivalently in the divergence of the fields h! . Fixing a finite Am we find a set of states with a finite 
complexity lower than the total one, the crucial point is that these states are no more marginal and the 
cavity method can be applied to them. The total complexity is obtained as the Am — * limit of the 
complexity of these states. To select a set of states different from the relevant ones we have considered 
states with a magnetization different from that of the relevant states, while in the selfoverlap was used. 
In the present context we could have considered any parameter A, different from the free energy, that can 
be written as 

A=- d Z, (94) 
dA 

where A is the conjugated field of the observable A, not to be confused with the parameter A^ that weighs 
the states. For instance we could have considered the entropy instead of the magntetization with the 
temperature as conjugated field. Here we want to show that in the limit Xa — > we would have obtained 
the same result for the total complexity and in general for the curve £(u). The proof is simple, indeed the 
shift of the parameter A can be obtained deriving the free energy shift and has two terms much as eq. (Illll : 

dA OA 4^ dhi dA v ' 

Now if we define the fields z as 

Zi = A 4 

dA 

It is easily seen that 



lim X A AA = AX (97) 

Indeed the first term in (|95|l does not depend on the z and vanishes anyway. This is the only term whose 
structure depends explicitly on the parameter A, instead the second term is simply proportional to the 
derivatives with respect to the fields hi and the dependence on A is hidden in the definition of the fields z%. 

In section El we have presented the annealed version of the theory. The annealed formulation has the 
advantage of yielding non-trivial results requiring only one distribution, i.e. we can study the dynamics of 
a single population. At variance with the RS result which is wrong physically and analitically, the annealed 
complexity is a well-defined object although the typical complexity is the quenched one yielded by the 
general theory. In general it gives an upper bound to the real complexity. 

We notice that the annealed theory coincides with the so-called factorized approximation ^3 [7\ 0] . 
Thus the factorized approximation has always a well-defined analytical meaning. In |20] it has been 
pointed out that in the T — > limit the field distributions should become concentrated over the integers 
and it has been argued that this property can be used to test wether a 1RSB solution is correct or is an 
approximation to a solution with more steps of replica-symmetry breaking. Thus an interesting question is 
wether the annealed solution satisfies this property. We note en passant that in the SK model the annealed 
solution is alway described by the BM solution i.e. the z fields are always non-zero, even at the lower 
band-edge which does not coincide with the equilibrium solution. 

In the SK model the quenched and the annealed total complexities coincide, and this remains true for 
the states of a given free energy /, provided / is greater than some f c JJ. Instead here we found that the 
annealed solution for the total complexity is unstable with respect to 1RSB and one may ask if the 1RSB 
solution is stable towards 2RSB and wether there is a given value of the free energy such that the annealed 
solution is stable towards 1RSB. 

The Ising p-spin model exhibits a phase transition from a non-SUSY complexity curve at high free 
energies similar to the one of the SK model 25 to a SUSY solution at low free energies that ends at the 
1RSB equilibrium free energy |2fil 1221 12*7] , The theory presented here can be extended to other models 
with finite connectivity such as XORSAT |23 and fc-SAT [51[|)|and it would be interesting to check for the 
presence of such a transition which would be marked by the presence of non-zero z fields possibly leading to 
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different thresholds. We also mention that a stability condition for the solution with non-zero z analogous 
to the condition of positivity of the replicon |20j is currently under investigation. Indeed in the Ising p-spin 
model the transition from a SUSY solution to a non-SUSY solution occurs precisely where the replicon 
eigenvalue becomes negative [22] • Thus to cure this instability it is sufficient to consider non-zero z-field 
without considering higher steps of RSB as proposed in ■ 

In section [7\ we presented an investigation of the theory at finite temperature. We have checked that 
population dynamics algorithms converge to non-trivial solutions of the equations of the theory, in particular 
the fields z are non-zero. A detailed analysis of the resulting complexity curves would require higher 
computational efforts because the complexity is extremely small at finite temperature. Indeed through 
series expansion in power of r = T c — T near T c = 1 we have checked that the behaviour of the total 
annealed complexity is the same of the SK model, i.e. S = 0(t 6 ) JT]. It seems reasonable to expect 
that the behaviour of the complexity curve £(/) be the same as the BM solution of the SK model, i.e. a 
bell-shaped curve markedly different from the supersymmetryc (SUSY) solution ^>JE1EI1E] that instead 
corresponds to set z — at all values of u @JIH|- However, as noted in ^1], the lower band edge of the 
curve £(/) in SK is described by the SUSY solution and therefore, as far as equilibrium properties are 
concerned, we do not need to consider the fields z because they vanish. Thus at the lower band edge the 
full-RSB version of the theory becomes the same of the full-RSB version of the Mezard and Parisi theory 
[3]. Numerically we can study only approximations of the real FRSB distribution, and in principle the 
theory with non-zero z may give a prediction for the equilibrium free energy f eq worse than the one of [H] 
that is in extremely good agreement with the numerical results quoted in pjj. The point deserves more 
investigation also in the SK model, indeed in SK the 1RSB SUSY solution yields a better result for f eq 
than the annealed solution but the properties of the quenched BM solution are not known at the present 
moment, neither at 1RSB nor at FRSB. 

In view of the extension to other finite connectivity models and optimization problems, it is very 
interesting to study the theory in the T — > limit and exactly at T = 0, work is in progress in these 
directions. Here we note that at low temperature the fields z diverge in a non-trivial way in the SK model. 
Indeed the parameters A and A governing the BM theory diverge linearly with with the same prefactor, as 
a consequence the Gaussian distribution of z and h before the reweighting eqs. I|50I51I52[1 has the following 
behaviour at low T: 

q ~ 1 (98) 

j = 0(1) (99) 

A = 0(/3) (100) 

thus the z fields diverge in a way that cannot be accounted for through a simple rescaling while the h fields 
remain finite. 
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